2026-10-29 19:38:39,269 [ 149958 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2026-10-29 19:38:39,269 [ 149958 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:79, check_args_and_update_paths) 2026-10-29 19:38:39,269 [ 149958 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:90, check_args_and_update_paths) 2026-10-29 19:38:39,269 [ 149958 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:92, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_u1sk54 --privileged --dns-search='.' --memory=30709022720 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel1_0.jsonl --report-log-exclude-logs-on-passed-tests test_executable_table_function/test.py::test_executable_function_input_argument_python test_executable_table_function/test.py::test_executable_function_input_bash test_executable_table_function/test.py::test_executable_function_input_multiple_pipes_python test_executable_table_function/test.py::test_executable_function_input_python test_executable_table_function/test.py::test_executable_function_input_signalled_python test_executable_table_function/test.py::test_executable_function_input_slow_python test_executable_table_function/test.py::test_executable_function_input_slow_python_timeout_increased test_executable_table_function/test.py::test_executable_function_input_sum_python test_executable_table_function/test.py::test_executable_function_no_input_bash test_executable_table_function/test.py::test_executable_function_no_input_python test_executable_table_function/test.py::test_executable_pool_storage_input_argument_python test_executable_table_function/test.py::test_executable_pool_storage_input_count_python test_executable_table_function/test.py::test_executable_pool_storage_input_multiple_pipes_python test_executable_table_function/test.py::test_executable_pool_storage_input_python test_executable_table_function/test.py::test_executable_pool_storage_input_signalled_python test_executable_table_function/test.py::test_executable_pool_storage_input_slow_python test_executable_table_function/test.py::test_executable_pool_storage_input_sum_python test_executable_table_function/test.py::test_executable_storage_input_argument_python test_executable_table_function/test.py::test_executable_storage_input_bash test_executable_table_function/test.py::test_executable_storage_input_python test_executable_table_function/test.py::test_executable_storage_input_send_chunk_header_python test_executable_table_function/test.py::test_executable_storage_input_signalled_python test_executable_table_function/test.py::test_executable_storage_input_slow_python test_executable_table_function/test.py::test_executable_storage_input_sum_python test_executable_table_function/test.py::test_executable_storage_no_input_bash test_executable_table_function/test.py::test_executable_storage_no_input_python test_hedged_requests_parallel/test.py::test_combination1 test_hedged_requests_parallel/test.py::test_combination2 test_hedged_requests_parallel/test.py::test_query_with_no_data_to_sample test_hedged_requests_parallel/test.py::test_send_data test_hedged_requests_parallel/test.py::test_send_table_status_sleep test_http_handlers_config/test.py::test_absolute_path_static_handler test_http_handlers_config/test.py::test_config_static_handler test_http_handlers_config/test.py::test_defaults_http_handlers test_http_handlers_config/test.py::test_defaults_http_handlers_config_order test_http_handlers_config/test.py::test_dynamic_query_handler test_http_handlers_config/test.py::test_fixed_static_handler test_http_handlers_config/test.py::test_predefined_query_handler test_http_handlers_config/test.py::test_prometheus_handler test_http_handlers_config/test.py::test_relative_path_static_handler test_http_handlers_config/test.py::test_replicas_status_handler test_intersecting_parts/test.py::test_intersect_parts_when_restart test_interserver_dns_retires/test.py::test_query test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_secure_client/test.py::test_connection test_keeper_three_nodes_start/test.py::test_smoke test_keeper_znode_time/test.py::test_between_servers test_keeper_znode_time/test.py::test_server_restart test_ldap_external_user_directory/test.py::test_authentication_fail test_ldap_external_user_directory/test.py::test_authentication_pass test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally test_ldap_external_user_directory/test.py::test_role_mapping test_logs_level/test.py::test_check_client_logs_level test_manipulate_statistics/test.py::test_replicated_db test_manipulate_statistics/test.py::test_replicated_table_ddl test_manipulate_statistics/test.py::test_single_node_normal test_manipulate_statistics/test.py::test_single_node_wide test_memory_profiler_min_max_borders/test.py::test_trace_boundaries_work test_merge_tree_azure_blob_storage/test.py::test_alter_table_columns test_merge_tree_azure_blob_storage/test.py::test_apply_new_settings test_merge_tree_azure_blob_storage/test.py::test_attach_detach_partition test_merge_tree_azure_blob_storage/test.py::test_azure_broken_parts test_merge_tree_azure_blob_storage/test.py::test_big_insert test_merge_tree_azure_blob_storage/test.py::test_create_table test_merge_tree_azure_blob_storage/test.py::test_endpoint test_merge_tree_azure_blob_storage/test.py::test_endpoint_error_check test_merge_tree_azure_blob_storage/test.py::test_endpoint_new_container test_merge_tree_azure_blob_storage/test.py::test_endpoint_without_prefix test_merge_tree_azure_blob_storage/test.py::test_freeze_unfreeze 'test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[False]' 'test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[True]' test_merge_tree_azure_blob_storage/test.py::test_inserts_selects test_merge_tree_azure_blob_storage/test.py::test_move_partition_to_another_disk test_merge_tree_azure_blob_storage/test.py::test_read_after_cache_is_wiped test_merge_tree_azure_blob_storage/test.py::test_simple_insert_select test_merge_tree_azure_blob_storage/test.py::test_table_manipulations test_odbc_interaction/test.py::test_concurrent_queries test_odbc_interaction/test.py::test_many_connections test_odbc_interaction/test.py::test_mysql_insert test_odbc_interaction/test.py::test_mysql_odbc_select_nullable test_odbc_interaction/test.py::test_mysql_simple_select_works test_odbc_interaction/test.py::test_no_connection_pooling -vvv " altinityinfra/integration-tests-runner:226bfaf75ac1 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_http_handlers_config/test.py::test_absolute_path_static_handler test_merge_tree_azure_blob_storage/test.py::test_alter_table_columns test_jbod_balancer/test.py::test_jbod_balanced_merge test_hedged_requests_parallel/test.py::test_combination1 test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_ldap_external_user_directory/test.py::test_authentication_fail test_manipulate_statistics/test.py::test_replicated_db test_odbc_interaction/test.py::test_concurrent_queries test_keeper_client/test.py::test_base_commands test_executable_table_function/test.py::test_executable_function_input_argument_python [gw3] [ 1%] PASSED test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family [gw3] [ 2%] PASSED test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups [gw3] [ 3%] PASSED test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes [gw3] [ 4%] PASSED test_keeper_client/test.py::test_find_super_nodes [gw1] [ 5%] PASSED test_http_handlers_config/test.py::test_absolute_path_static_handler test_http_handlers_config/test.py::test_config_static_handler test_keeper_client/test.py::test_four_letter_word_commands [gw3] [ 6%] PASSED test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number [gw3] [ 7%] PASSED test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing [gw3] [ 8%] PASSED test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version [gw3] [ 9%] PASSED test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version [gw3] [ 10%] PASSED test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version [gw3] [ 11%] PASSED test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version [gw3] [ 12%] PASSED test_keeper_client/test.py::test_set_without_version [gw8] [ 13%] PASSED test_manipulate_statistics/test.py::test_replicated_db test_manipulate_statistics/test.py::test_replicated_table_ddl [gw7] [ 14%] PASSED test_ldap_external_user_directory/test.py::test_authentication_fail test_ldap_external_user_directory/test.py::test_authentication_pass test_intersecting_parts/test.py::test_intersect_parts_when_restart [gw7] [ 15%] PASSED test_ldap_external_user_directory/test.py::test_authentication_pass test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes [gw2] [ 16%] PASSED test_executable_table_function/test.py::test_executable_function_input_argument_python test_executable_table_function/test.py::test_executable_function_input_bash [gw2] [ 17%] PASSED test_executable_table_function/test.py::test_executable_function_input_bash test_executable_table_function/test.py::test_executable_function_input_multiple_pipes_python [gw2] [ 18%] PASSED test_executable_table_function/test.py::test_executable_function_input_multiple_pipes_python test_executable_table_function/test.py::test_executable_function_input_python [gw7] [ 19%] PASSED test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally [gw6] [ 20%] PASSED test_hedged_requests_parallel/test.py::test_combination1 test_hedged_requests_parallel/test.py::test_combination2 [gw4] [ 21%] SKIPPED test_odbc_interaction/test.py::test_concurrent_queries test_odbc_interaction/test.py::test_many_connections [gw2] [ 22%] PASSED test_executable_table_function/test.py::test_executable_function_input_python test_executable_table_function/test.py::test_executable_function_input_signalled_python [gw8] [ 23%] PASSED test_manipulate_statistics/test.py::test_replicated_table_ddl test_manipulate_statistics/test.py::test_single_node_normal [gw4] [ 24%] SKIPPED test_odbc_interaction/test.py::test_many_connections test_odbc_interaction/test.py::test_mysql_insert [gw4] [ 25%] SKIPPED test_odbc_interaction/test.py::test_mysql_insert test_odbc_interaction/test.py::test_mysql_odbc_select_nullable [gw7] [ 26%] PASSED test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally test_ldap_external_user_directory/test.py::test_role_mapping [gw1] [ 27%] PASSED test_http_handlers_config/test.py::test_config_static_handler test_http_handlers_config/test.py::test_defaults_http_handlers [gw4] [ 28%] SKIPPED test_odbc_interaction/test.py::test_mysql_odbc_select_nullable test_odbc_interaction/test.py::test_mysql_simple_select_works [gw2] [ 29%] PASSED test_executable_table_function/test.py::test_executable_function_input_signalled_python test_executable_table_function/test.py::test_executable_function_input_slow_python [gw4] [ 30%] SKIPPED test_odbc_interaction/test.py::test_mysql_simple_select_works test_odbc_interaction/test.py::test_no_connection_pooling [gw4] [ 31%] SKIPPED test_odbc_interaction/test.py::test_no_connection_pooling [gw3] [ 32%] PASSED test_intersecting_parts/test.py::test_intersect_parts_when_restart [gw7] [ 33%] PASSED test_ldap_external_user_directory/test.py::test_role_mapping test_logs_level/test.py::test_check_client_logs_level [gw5] [ 34%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command [gw0] [ 35%] PASSED test_merge_tree_azure_blob_storage/test.py::test_alter_table_columns test_merge_tree_azure_blob_storage/test.py::test_apply_new_settings test_interserver_dns_retires/test.py::test_query [gw6] [ 36%] FAILED test_hedged_requests_parallel/test.py::test_combination2 test_hedged_requests_parallel/test.py::test_query_with_no_data_to_sample [gw0] [ 37%] PASSED test_merge_tree_azure_blob_storage/test.py::test_apply_new_settings test_merge_tree_azure_blob_storage/test.py::test_attach_detach_partition [gw9] [ 38%] PASSED test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch [gw1] [ 39%] PASSED test_http_handlers_config/test.py::test_defaults_http_handlers test_http_handlers_config/test.py::test_defaults_http_handlers_config_order [gw8] [ 40%] PASSED test_manipulate_statistics/test.py::test_single_node_normal test_manipulate_statistics/test.py::test_single_node_wide [gw0] [ 41%] PASSED test_merge_tree_azure_blob_storage/test.py::test_attach_detach_partition test_merge_tree_azure_blob_storage/test.py::test_azure_broken_parts [gw4] [ 42%] PASSED test_logs_level/test.py::test_check_client_logs_level test_memory_profiler_min_max_borders/test.py::test_trace_boundaries_work [gw0] [ 43%] PASSED test_merge_tree_azure_blob_storage/test.py::test_azure_broken_parts test_merge_tree_azure_blob_storage/test.py::test_big_insert [gw2] [ 44%] PASSED test_executable_table_function/test.py::test_executable_function_input_slow_python test_executable_table_function/test.py::test_executable_function_input_slow_python_timeout_increased [gw6] [ 45%] PASSED test_hedged_requests_parallel/test.py::test_query_with_no_data_to_sample test_hedged_requests_parallel/test.py::test_send_data [gw4] [ 46%] SKIPPED test_memory_profiler_min_max_borders/test.py::test_trace_boundaries_work [gw8] [ 47%] PASSED test_manipulate_statistics/test.py::test_single_node_wide [gw0] [ 48%] PASSED test_merge_tree_azure_blob_storage/test.py::test_big_insert test_merge_tree_azure_blob_storage/test.py::test_create_table [gw0] [ 49%] PASSED test_merge_tree_azure_blob_storage/test.py::test_create_table test_merge_tree_azure_blob_storage/test.py::test_endpoint [gw0] [ 50%] PASSED test_merge_tree_azure_blob_storage/test.py::test_endpoint test_merge_tree_azure_blob_storage/test.py::test_endpoint_error_check [gw0] [ 51%] PASSED test_merge_tree_azure_blob_storage/test.py::test_endpoint_error_check test_merge_tree_azure_blob_storage/test.py::test_endpoint_new_container [gw0] [ 52%] PASSED test_merge_tree_azure_blob_storage/test.py::test_endpoint_new_container test_merge_tree_azure_blob_storage/test.py::test_endpoint_without_prefix test_keeper_secure_client/test.py::test_connection [gw0] [ 53%] PASSED test_merge_tree_azure_blob_storage/test.py::test_endpoint_without_prefix test_merge_tree_azure_blob_storage/test.py::test_freeze_unfreeze [gw3] [ 54%] PASSED test_interserver_dns_retires/test.py::test_query test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena [gw6] [ 55%] PASSED test_hedged_requests_parallel/test.py::test_send_data test_hedged_requests_parallel/test.py::test_send_table_status_sleep [gw0] [ 56%] PASSED test_merge_tree_azure_blob_storage/test.py::test_freeze_unfreeze test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[False] [gw1] [ 57%] PASSED test_http_handlers_config/test.py::test_defaults_http_handlers_config_order test_http_handlers_config/test.py::test_dynamic_query_handler [gw3] [ 58%] SKIPPED test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena [gw8] [ 59%] PASSED test_keeper_secure_client/test.py::test_connection [gw7] [ 60%] PASSED test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command [gw6] [ 61%] PASSED test_hedged_requests_parallel/test.py::test_send_table_status_sleep [gw0] [ 62%] PASSED test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[False] test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[True] [gw1] [ 63%] PASSED test_http_handlers_config/test.py::test_dynamic_query_handler test_http_handlers_config/test.py::test_fixed_static_handler test_keeper_three_nodes_start/test.py::test_smoke [gw0] [ 64%] PASSED test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[True] test_merge_tree_azure_blob_storage/test.py::test_inserts_selects [gw1] [ 65%] PASSED test_http_handlers_config/test.py::test_fixed_static_handler test_http_handlers_config/test.py::test_predefined_query_handler [gw0] [ 66%] PASSED test_merge_tree_azure_blob_storage/test.py::test_inserts_selects test_merge_tree_azure_blob_storage/test.py::test_move_partition_to_another_disk [gw0] [ 67%] PASSED test_merge_tree_azure_blob_storage/test.py::test_move_partition_to_another_disk test_merge_tree_azure_blob_storage/test.py::test_read_after_cache_is_wiped [gw0] [ 68%] PASSED test_merge_tree_azure_blob_storage/test.py::test_read_after_cache_is_wiped test_merge_tree_azure_blob_storage/test.py::test_simple_insert_select [gw0] [ 69%] PASSED test_merge_tree_azure_blob_storage/test.py::test_simple_insert_select test_merge_tree_azure_blob_storage/test.py::test_table_manipulations [gw2] [ 70%] PASSED test_executable_table_function/test.py::test_executable_function_input_slow_python_timeout_increased test_executable_table_function/test.py::test_executable_function_input_sum_python [gw2] [ 71%] PASSED test_executable_table_function/test.py::test_executable_function_input_sum_python test_executable_table_function/test.py::test_executable_function_no_input_bash [gw2] [ 72%] PASSED test_executable_table_function/test.py::test_executable_function_no_input_bash test_executable_table_function/test.py::test_executable_function_no_input_python [gw2] [ 73%] PASSED test_executable_table_function/test.py::test_executable_function_no_input_python test_executable_table_function/test.py::test_executable_pool_storage_input_argument_python [gw0] [ 74%] PASSED test_merge_tree_azure_blob_storage/test.py::test_table_manipulations [gw2] [ 75%] PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_argument_python test_executable_table_function/test.py::test_executable_pool_storage_input_count_python [gw1] [ 76%] PASSED test_http_handlers_config/test.py::test_predefined_query_handler test_http_handlers_config/test.py::test_prometheus_handler [gw2] [ 77%] PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_count_python test_executable_table_function/test.py::test_executable_pool_storage_input_multiple_pipes_python [gw2] [ 78%] PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_multiple_pipes_python test_executable_table_function/test.py::test_executable_pool_storage_input_python [gw9] [ 79%] PASSED test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch [gw2] [ 80%] PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_python test_executable_table_function/test.py::test_executable_pool_storage_input_signalled_python [gw7] [ 81%] PASSED test_keeper_three_nodes_start/test.py::test_smoke [gw1] [ 82%] PASSED test_http_handlers_config/test.py::test_prometheus_handler test_http_handlers_config/test.py::test_relative_path_static_handler test_keeper_znode_time/test.py::test_between_servers [gw2] [ 83%] PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_signalled_python test_executable_table_function/test.py::test_executable_pool_storage_input_slow_python [gw1] [ 84%] PASSED test_http_handlers_config/test.py::test_relative_path_static_handler test_http_handlers_config/test.py::test_replicas_status_handler [gw9] [ 85%] PASSED test_keeper_znode_time/test.py::test_between_servers test_keeper_znode_time/test.py::test_server_restart [gw1] [ 86%] PASSED test_http_handlers_config/test.py::test_replicas_status_handler [gw9] [ 87%] PASSED test_keeper_znode_time/test.py::test_server_restart [gw2] [ 88%] PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_slow_python test_executable_table_function/test.py::test_executable_pool_storage_input_sum_python [gw2] [ 89%] PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_sum_python test_executable_table_function/test.py::test_executable_storage_input_argument_python [gw2] [ 90%] PASSED test_executable_table_function/test.py::test_executable_storage_input_argument_python test_executable_table_function/test.py::test_executable_storage_input_bash [gw2] [ 91%] PASSED test_executable_table_function/test.py::test_executable_storage_input_bash test_executable_table_function/test.py::test_executable_storage_input_python [gw2] [ 92%] PASSED test_executable_table_function/test.py::test_executable_storage_input_python test_executable_table_function/test.py::test_executable_storage_input_send_chunk_header_python [gw2] [ 93%] PASSED test_executable_table_function/test.py::test_executable_storage_input_send_chunk_header_python test_executable_table_function/test.py::test_executable_storage_input_signalled_python [gw2] [ 94%] PASSED test_executable_table_function/test.py::test_executable_storage_input_signalled_python test_executable_table_function/test.py::test_executable_storage_input_slow_python [gw5] [ 95%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv [gw2] [ 96%] PASSED test_executable_table_function/test.py::test_executable_storage_input_slow_python test_executable_table_function/test.py::test_executable_storage_input_sum_python [gw2] [ 97%] PASSED test_executable_table_function/test.py::test_executable_storage_input_sum_python test_executable_table_function/test.py::test_executable_storage_no_input_bash [gw2] [ 98%] PASSED test_executable_table_function/test.py::test_executable_storage_no_input_bash test_executable_table_function/test.py::test_executable_storage_no_input_python [gw2] [ 99%] PASSED test_executable_table_function/test.py::test_executable_storage_no_input_python [gw5] [100%] PASSED test_kafka_bad_messages/test.py::test_bad_messages_to_mv =================================== FAILURES =================================== ______________________________ test_combination2 _______________________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_combination2(started_cluster): if NODES["node"].is_built_with_thread_sanitizer(): pytest.skip("Hedged requests don't work under Thread Sanitizer") update_configs( node_1_sleep_in_send_data=sleep_time, node_2_sleep_in_send_tables_status=1000, node_3_sleep_in_send_data=sleep_time, node_4_sleep_in_send_tables_status=1000, ) > check_query() test_hedged_requests_parallel/test.py:220: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ query = 'SELECT count() FROM distributed' def check_query(query=QUERY_1): NODES["node"].restart_clickhouse() # Without hedged requests select query will last more than 30 seconds, # with hedged requests it will last just around 1-2 second start = time.time() NODES["node"].query(query) query_time = time.time() - start print("Query time:", query_time) > assert query_time < 5 E assert 6.04084849357605 < 5 test_hedged_requests_parallel/test.py:85: AssertionError ----------------------------- Captured stdout call ----------------------------- Query time: 6.04084849357605 ------------------------------ Captured log call ------------------------------- 2026-10-29 19:39:36.614000 [ 623 ] DEBUG : Executing query SELECT value FROM system.build_options WHERE name = 'CXX_FLAGS' on node (cluster.py:3648, query) 2026-10-29 19:39:37.321000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node_1-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n 0\n 30000\n \n \n' > /etc/clickhouse-server/users.d/users1.xml"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:37.321000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node_1-1 bash -c echo ' 0 30000 ' > /etc/clickhouse-server/users.d/users1.xml] (cluster.py:121, run_and_check) 2026-10-29 19:39:37.495000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node_2-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n 1000\n 0\n \n \n' > /etc/clickhouse-server/users.d/users1.xml"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:37.496000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node_2-1 bash -c echo ' 1000 0 ' > /etc/clickhouse-server/users.d/users1.xml] (cluster.py:121, run_and_check) 2026-10-29 19:39:37.667000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node_3-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n 0\n 30000\n \n \n' > /etc/clickhouse-server/users.d/users1.xml"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:37.668000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node_3-1 bash -c echo ' 0 30000 ' > /etc/clickhouse-server/users.d/users1.xml] (cluster.py:121, run_and_check) 2026-10-29 19:39:38.025000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node_4-1 detach:False nothrow:False cmd: ['bash', '-c', "echo '\n \n \n 1000\n 0\n \n \n' > /etc/clickhouse-server/users.d/users1.xml"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:38.025000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node_4-1 bash -c echo ' 1000 0 ' > /etc/clickhouse-server/users.d/users1.xml] (cluster.py:121, run_and_check) 2026-10-29 19:39:38.248000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_tables_status_ms' on node_1 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:38.251000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.2:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:38.385000 [ 623 ] DEBUG : http://172.16.4.2:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_tables_status_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:38.387000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_data_ms' on node_1 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:38.390000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.2:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:38.536000 [ 623 ] DEBUG : http://172.16.4.2:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_data_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:38.654000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_tables_status_ms' on node_1 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:38.657000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.2:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:38.849000 [ 623 ] DEBUG : http://172.16.4.2:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_tables_status_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:38.865000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_data_ms' on node_1 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:38.868000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.2:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:39.045000 [ 623 ] DEBUG : http://172.16.4.2:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_data_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:39.175000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_tables_status_ms' on node_1 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:39.178000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.2:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:39.236000 [ 623 ] DEBUG : http://172.16.4.2:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_tables_status_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:39.239000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_data_ms' on node_1 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:39.242000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.2:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:39.367000 [ 623 ] DEBUG : http://172.16.4.2:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_data_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:39.477000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_tables_status_ms' on node_1 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:39.480000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.2:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:39.634000 [ 623 ] DEBUG : http://172.16.4.2:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_tables_status_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:39.659000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_data_ms' on node_1 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:39.662000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.2:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:39.787000 [ 623 ] DEBUG : http://172.16.4.2:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_data_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:39.804000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_tables_status_ms' on node_2 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:39.807000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.6:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:39.981000 [ 623 ] DEBUG : http://172.16.4.6:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_tables_status_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:40.000000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_data_ms' on node_2 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:40.006000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.6:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:40.169000 [ 623 ] DEBUG : http://172.16.4.6:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_data_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:40.180000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_tables_status_ms' on node_3 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:40.183000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.4:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:40.229000 [ 623 ] DEBUG : http://172.16.4.4:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_tables_status_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:40.239000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_data_ms' on node_3 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:40.242000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.4:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:40.310000 [ 623 ] DEBUG : http://172.16.4.4:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_data_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:40.312000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_tables_status_ms' on node_4 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:40.316000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.5:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:40.473000 [ 623 ] DEBUG : http://172.16.4.5:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_tables_status_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:40.491000 [ 623 ] DEBUG : Executing query SELECT value FROM system.settings WHERE name='sleep_in_send_data_ms' on node_4 via HTTP interface (cluster.py:3899, http_query_and_get_answer_with_error) 2026-10-29 19:39:40.493000 [ 623 ] DEBUG : Starting new HTTP connection (1): 172.16.4.5:8123 (connectionpool.py:245, _new_conn) 2026-10-29 19:39:40.589000 [ 623 ] DEBUG : http://172.16.4.5:8123 "GET /?query=SELECT+value+FROM+system.settings+WHERE+name%3D%27sleep_in_send_data_ms%27 HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2026-10-29 19:39:40.603000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node-1 detach:False nothrow:True cmd: ['bash', '-c', 'ps -C clickhouse'] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:40.604000 [ 623 ] DEBUG : Command:[docker exec -u root roottesthedgedrequestsparallel-gw6-node-1 bash -c ps -C clickhouse] (cluster.py:121, run_and_check) 2026-10-29 19:39:40.881000 [ 623 ] DEBUG : Stdout: PID TTY TIME CMD (cluster.py:145, run_and_check) 2026-10-29 19:39:40.881000 [ 623 ] DEBUG : Stdout: 776 ? 00:00:06 clickhouse (cluster.py:145, run_and_check) 2026-10-29 19:39:40.882000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', 'pkill clickhouse'] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:40.882000 [ 623 ] DEBUG : Command:[docker exec -u root roottesthedgedrequestsparallel-gw6-node-1 bash -c pkill clickhouse] (cluster.py:121, run_and_check) 2026-10-29 19:39:41.138000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:41.138000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2026-10-29 19:39:41.439000 [ 623 ] DEBUG : Stdout:776 (cluster.py:145, run_and_check) 2026-10-29 19:39:42.440000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:42.441000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2026-10-29 19:39:42.676000 [ 623 ] DEBUG : Stdout:776 (cluster.py:145, run_and_check) 2026-10-29 19:39:43.677000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:43.678000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2026-10-29 19:39:43.963000 [ 623 ] DEBUG : Stdout:776 (cluster.py:145, run_and_check) 2026-10-29 19:39:44.968000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:44.968000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2026-10-29 19:39:45.219000 [ 623 ] DEBUG : Stdout:776 (cluster.py:145, run_and_check) 2026-10-29 19:39:46.220000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:46.221000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2026-10-29 19:39:46.472000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:46.473000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2026-10-29 19:39:46.771000 [ 623 ] DEBUG : No clickhouse process running. Start new one. (cluster.py:4014, start_clickhouse) 2026-10-29 19:39:46.794000 [ 623 ] DEBUG : http://localhost:None "POST /v1.46/containers/roottesthedgedrequestsparallel-gw6-node-1/exec HTTP/1.1" 201 74 (connectionpool.py:547, _make_request) 2026-10-29 19:39:46.913000 [ 623 ] DEBUG : http://localhost:None "POST /v1.46/exec/950a91bf6285b57c021d0546dab97250504332da1776d7bd751a6d9e403b748e/start HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2026-10-29 19:39:46.918000 [ 623 ] DEBUG : http://localhost:None "GET /v1.46/exec/950a91bf6285b57c021d0546dab97250504332da1776d7bd751a6d9e403b748e/json HTTP/1.1" 200 586 (connectionpool.py:547, _make_request) 2026-10-29 19:39:47.920000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:47.921000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2026-10-29 19:39:48.207000 [ 623 ] DEBUG : Stdout:1558 (cluster.py:145, run_and_check) 2026-10-29 19:39:48.207000 [ 623 ] DEBUG : Clickhouse process running. (cluster.py:4028, start_clickhouse) 2026-10-29 19:39:48.208000 [ 623 ] DEBUG : run container_id:roottesthedgedrequestsparallel-gw6-node-1 detach:False nothrow:False cmd: ['bash', '-c', "ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'"] (cluster.py:2051, exec_in_container) 2026-10-29 19:39:48.208000 [ 623 ] DEBUG : Command:[docker exec roottesthedgedrequestsparallel-gw6-node-1 bash -c ps ax | grep 'clickhouse' | grep -v 'grep' | grep -v 'coproc' | grep -v 'bash -c' | awk '{print $1}'] (cluster.py:121, run_and_check) 2026-10-29 19:39:48.434000 [ 623 ] DEBUG : Stdout:1558 (cluster.py:145, run_and_check) 2026-10-29 19:39:48.434000 [ 623 ] DEBUG : Executing query select 20 on node (cluster.py:3648, query) 2026-10-29 19:39:49.569000 [ 623 ] DEBUG : Executing query select 20 on node (cluster.py:3648, query) 2026-10-29 19:39:50.701000 [ 623 ] DEBUG : Executing query select 20 on node (cluster.py:3648, query) 2026-10-29 19:39:51.969000 [ 623 ] DEBUG : Executing query select 20 on node (cluster.py:3648, query) 2026-10-29 19:39:53.464000 [ 623 ] DEBUG : Executing query select 20 on node (cluster.py:3648, query) 2026-10-29 19:39:54.688000 [ 623 ] DEBUG : Executing query select 20 on node (cluster.py:3648, query) 2026-10-29 19:39:55.996000 [ 623 ] DEBUG : Executing query select 20 on node (cluster.py:3648, query) 2026-10-29 19:39:57.053000 [ 623 ] DEBUG : Executing query SELECT count() FROM distributed on node (cluster.py:3648, query) ----------------- generated report log file: parallel1_0.jsonl ----------------- ============================== slowest durations =============================== 294.76s call test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream 145.43s call test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch 102.99s call test_executable_table_function/test.py::test_executable_function_input_slow_python_timeout_increased 80.51s call test_executable_table_function/test.py::test_executable_pool_storage_input_slow_python 63.34s call test_interserver_dns_retires/test.py::test_query 62.97s setup test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception 59.98s call test_http_handlers_config/test.py::test_defaults_http_handlers_config_order 59.82s setup test_merge_tree_azure_blob_storage/test.py::test_alter_table_columns 58.14s call test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command 57.99s call test_jbod_balancer/test.py::test_jbod_balanced_merge 56.17s call test_keeper_three_nodes_start/test.py::test_smoke 50.55s setup test_odbc_interaction/test.py::test_concurrent_queries 42.84s call test_executable_table_function/test.py::test_executable_function_input_slow_python 39.14s call test_hedged_requests_parallel/test.py::test_send_data 35.34s call test_manipulate_statistics/test.py::test_single_node_wide 34.96s teardown test_merge_tree_azure_blob_storage/test.py::test_table_manipulations 34.49s teardown test_kafka_bad_messages/test.py::test_bad_messages_to_mv 31.61s setup test_ldap_external_user_directory/test.py::test_authentication_fail 31.52s setup test_executable_table_function/test.py::test_executable_function_input_argument_python 30.73s call test_manipulate_statistics/test.py::test_single_node_normal 29.90s call test_http_handlers_config/test.py::test_config_static_handler 29.01s call test_keeper_znode_time/test.py::test_server_restart 28.67s call test_executable_table_function/test.py::test_executable_storage_input_slow_python 28.00s call test_http_handlers_config/test.py::test_defaults_http_handlers 26.48s call test_hedged_requests_parallel/test.py::test_combination2 25.89s setup test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command 25.47s call test_merge_tree_azure_blob_storage/test.py::test_big_insert 24.54s call test_http_handlers_config/test.py::test_dynamic_query_handler 24.36s setup test_hedged_requests_parallel/test.py::test_combination1 24.35s call test_http_handlers_config/test.py::test_predefined_query_handler 24.26s call test_hedged_requests_parallel/test.py::test_query_with_no_data_to_sample 24.21s call test_http_handlers_config/test.py::test_absolute_path_static_handler 23.82s setup test_jbod_balancer/test.py::test_jbod_balanced_merge 23.37s setup test_manipulate_statistics/test.py::test_replicated_db 23.28s call test_keeper_znode_time/test.py::test_between_servers 23.18s call test_manipulate_statistics/test.py::test_replicated_table_ddl 23.04s call test_hedged_requests_parallel/test.py::test_combination1 22.64s call test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[False] 22.54s setup test_keeper_client/test.py::test_base_commands 21.91s call test_http_handlers_config/test.py::test_replicas_status_handler 21.22s setup test_memory_profiler_min_max_borders/test.py::test_trace_boundaries_work 20.75s call test_http_handlers_config/test.py::test_relative_path_static_handler 20.48s call test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[True] 19.77s setup test_keeper_secure_client/test.py::test_connection 19.71s call test_http_handlers_config/test.py::test_prometheus_handler 19.56s call test_http_handlers_config/test.py::test_fixed_static_handler 19.30s call test_hedged_requests_parallel/test.py::test_send_table_status_sleep 18.12s teardown test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command 17.27s setup test_logs_level/test.py::test_check_client_logs_level 17.00s call test_kafka_bad_messages/test.py::test_bad_messages_to_mv 16.78s setup test_keeper_znode_time/test.py::test_between_servers 16.73s setup test_intersecting_parts/test.py::test_intersect_parts_when_restart 14.18s teardown test_odbc_interaction/test.py::test_no_connection_pooling 13.81s call test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena 13.17s call test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes 13.09s teardown test_manipulate_statistics/test.py::test_single_node_wide 12.85s call test_merge_tree_azure_blob_storage/test.py::test_alter_table_columns 12.24s call test_intersecting_parts/test.py::test_intersect_parts_when_restart 11.70s call test_ldap_external_user_directory/test.py::test_role_mapping 10.97s teardown test_intersecting_parts/test.py::test_intersect_parts_when_restart 10.14s call test_merge_tree_azure_blob_storage/test.py::test_attach_detach_partition 9.29s teardown test_hedged_requests_parallel/test.py::test_send_table_status_sleep 8.73s call test_merge_tree_azure_blob_storage/test.py::test_freeze_unfreeze 8.73s call test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception 8.49s call test_executable_table_function/test.py::test_executable_function_input_python 8.10s call test_merge_tree_azure_blob_storage/test.py::test_table_manipulations 7.38s teardown test_keeper_secure_client/test.py::test_connection 7.36s teardown test_memory_profiler_min_max_borders/test.py::test_trace_boundaries_work 7.17s call test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally 6.85s call test_executable_table_function/test.py::test_executable_function_input_multiple_pipes_python 6.78s call test_merge_tree_azure_blob_storage/test.py::test_azure_broken_parts 6.51s teardown test_logs_level/test.py::test_check_client_logs_level 6.50s teardown test_ldap_external_user_directory/test.py::test_role_mapping 6.36s call test_executable_table_function/test.py::test_executable_pool_storage_input_count_python 5.84s call test_executable_table_function/test.py::test_executable_pool_storage_input_python 5.83s call test_executable_table_function/test.py::test_executable_pool_storage_input_signalled_python 5.80s call test_merge_tree_azure_blob_storage/test.py::test_move_partition_to_another_disk 5.76s call test_executable_table_function/test.py::test_executable_pool_storage_input_argument_python 5.74s call test_executable_table_function/test.py::test_executable_pool_storage_input_multiple_pipes_python 5.70s call test_manipulate_statistics/test.py::test_replicated_db 5.54s call test_executable_table_function/test.py::test_executable_pool_storage_input_sum_python 5.06s call test_merge_tree_azure_blob_storage/test.py::test_apply_new_settings 4.90s teardown test_keeper_client/test.py::test_set_without_version 4.40s call test_merge_tree_azure_blob_storage/test.py::test_inserts_selects 4.10s teardown test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch 3.86s call test_executable_table_function/test.py::test_executable_storage_input_send_chunk_header_python 3.81s call test_executable_table_function/test.py::test_executable_storage_input_sum_python 3.80s call test_executable_table_function/test.py::test_executable_storage_input_python 3.70s call test_executable_table_function/test.py::test_executable_storage_input_argument_python 3.66s call test_executable_table_function/test.py::test_executable_storage_input_signalled_python 3.46s call test_executable_table_function/test.py::test_executable_storage_input_bash 3.42s call test_merge_tree_azure_blob_storage/test.py::test_read_after_cache_is_wiped 3.21s call test_executable_table_function/test.py::test_executable_function_input_signalled_python 3.13s call test_merge_tree_azure_blob_storage/test.py::test_endpoint_error_check 2.85s call test_merge_tree_azure_blob_storage/test.py::test_simple_insert_select 2.79s call test_executable_table_function/test.py::test_executable_function_input_bash 2.45s call test_executable_table_function/test.py::test_executable_storage_no_input_bash 2.37s call test_merge_tree_azure_blob_storage/test.py::test_create_table 2.30s call test_executable_table_function/test.py::test_executable_storage_no_input_python 2.25s call test_merge_tree_azure_blob_storage/test.py::test_endpoint_without_prefix 2.20s teardown test_keeper_znode_time/test.py::test_server_restart 2.15s call test_executable_table_function/test.py::test_executable_function_input_argument_python 2.05s call test_merge_tree_azure_blob_storage/test.py::test_endpoint_new_container 1.93s teardown test_executable_table_function/test.py::test_executable_storage_no_input_python 1.87s call test_executable_table_function/test.py::test_executable_function_input_sum_python 1.80s call test_merge_tree_azure_blob_storage/test.py::test_endpoint 1.16s call test_odbc_interaction/test.py::test_concurrent_queries 1.11s call test_ldap_external_user_directory/test.py::test_authentication_fail 1.05s call test_executable_table_function/test.py::test_executable_function_no_input_python 1.04s call test_odbc_interaction/test.py::test_many_connections 0.94s call test_executable_table_function/test.py::test_executable_function_no_input_bash 0.81s call test_odbc_interaction/test.py::test_no_connection_pooling 0.81s call test_odbc_interaction/test.py::test_mysql_simple_select_works 0.80s call test_odbc_interaction/test.py::test_mysql_insert 0.78s call test_odbc_interaction/test.py::test_mysql_odbc_select_nullable 0.73s call test_ldap_external_user_directory/test.py::test_authentication_pass 0.66s call test_memory_profiler_min_max_borders/test.py::test_trace_boundaries_work 0.62s call test_logs_level/test.py::test_check_client_logs_level 0.58s call test_keeper_secure_client/test.py::test_connection 0.54s setup test_keeper_client/test.py::test_get_all_children_number 0.42s setup test_keeper_client/test.py::test_quoted_argument_parsing 0.35s setup test_keeper_client/test.py::test_set_with_version 0.33s setup test_keeper_client/test.py::test_rm_with_version 0.32s setup test_keeper_client/test.py::test_big_family 0.30s setup test_keeper_client/test.py::test_set_without_version 0.28s teardown test_keeper_client/test.py::test_quoted_argument_parsing 0.27s setup test_keeper_client/test.py::test_delete_stale_backups 0.26s setup test_keeper_client/test.py::test_rm_without_version 0.26s call test_keeper_client/test.py::test_get_all_children_number 0.26s setup test_keeper_client/test.py::test_find_super_nodes 0.21s setup test_keeper_client/test.py::test_four_letter_word_commands 0.16s call test_keeper_client/test.py::test_big_family 0.15s teardown test_keeper_client/test.py::test_set_with_version 0.15s teardown test_keeper_client/test.py::test_get_all_children_number 0.14s teardown test_keeper_client/test.py::test_base_commands 0.13s call test_keeper_client/test.py::test_find_super_nodes 0.11s teardown test_keeper_client/test.py::test_rm_without_version 0.11s teardown test_keeper_client/test.py::test_find_super_nodes 0.11s teardown test_keeper_client/test.py::test_big_family 0.11s call test_keeper_client/test.py::test_set_with_version 0.10s call test_keeper_client/test.py::test_quoted_argument_parsing 0.10s teardown test_keeper_client/test.py::test_rm_with_version 0.10s call test_keeper_client/test.py::test_delete_stale_backups 0.09s teardown test_keeper_client/test.py::test_delete_stale_backups 0.09s teardown test_keeper_client/test.py::test_four_letter_word_commands 0.08s setup test_http_handlers_config/test.py::test_absolute_path_static_handler 0.07s call test_keeper_client/test.py::test_base_commands 0.06s call test_keeper_client/test.py::test_rm_with_version 0.05s call test_keeper_client/test.py::test_rm_without_version 0.05s call test_keeper_client/test.py::test_set_without_version 0.02s teardown test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes 0.02s teardown test_keeper_znode_time/test.py::test_between_servers 0.01s teardown test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream 0.01s teardown test_merge_tree_azure_blob_storage/test.py::test_alter_table_columns 0.01s teardown test_hedged_requests_parallel/test.py::test_query_with_no_data_to_sample 0.01s setup test_http_handlers_config/test.py::test_defaults_http_handlers 0.01s teardown test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception 0.00s call test_keeper_client/test.py::test_four_letter_word_commands 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_endpoint_without_prefix 0.00s teardown test_jbod_balancer/test.py::test_jbod_balanced_merge 0.00s setup test_http_handlers_config/test.py::test_dynamic_query_handler 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_apply_new_settings 0.00s teardown test_hedged_requests_parallel/test.py::test_combination2 0.00s setup test_ldap_external_user_directory/test.py::test_role_mapping 0.00s setup test_keeper_three_nodes_start/test.py::test_smoke 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_create_table 0.00s teardown test_interserver_dns_retires/test.py::test_query 0.00s teardown test_hedged_requests_parallel/test.py::test_combination1 0.00s teardown test_http_handlers_config/test.py::test_replicas_status_handler 0.00s teardown test_http_handlers_config/test.py::test_defaults_http_handlers_config_order 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[False] 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_azure_broken_parts 0.00s setup test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena 0.00s teardown test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena 0.00s setup test_manipulate_statistics/test.py::test_single_node_normal 0.00s setup test_http_handlers_config/test.py::test_defaults_http_handlers_config_order 0.00s setup test_executable_table_function/test.py::test_executable_function_input_sum_python 0.00s teardown test_http_handlers_config/test.py::test_config_static_handler 0.00s setup test_interserver_dns_retires/test.py::test_query 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_big_insert 0.00s setup test_executable_table_function/test.py::test_executable_pool_storage_input_python 0.00s teardown test_keeper_three_nodes_start/test.py::test_smoke 0.00s setup test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes 0.00s setup test_executable_table_function/test.py::test_executable_storage_input_python 0.00s setup test_executable_table_function/test.py::test_executable_storage_no_input_python 0.00s setup test_http_handlers_config/test.py::test_prometheus_handler 0.00s teardown test_http_handlers_config/test.py::test_absolute_path_static_handler 0.00s setup test_keeper_znode_time/test.py::test_server_restart 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_big_insert 0.00s teardown test_http_handlers_config/test.py::test_predefined_query_handler 0.00s teardown test_executable_table_function/test.py::test_executable_pool_storage_input_sum_python 0.00s setup test_http_handlers_config/test.py::test_predefined_query_handler 0.00s teardown test_executable_table_function/test.py::test_executable_pool_storage_input_multiple_pipes_python 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_endpoint_new_container 0.00s teardown test_http_handlers_config/test.py::test_defaults_http_handlers 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_endpoint_error_check 0.00s setup test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[True] 0.00s setup test_executable_table_function/test.py::test_executable_pool_storage_input_sum_python 0.00s setup test_hedged_requests_parallel/test.py::test_send_data 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_move_partition_to_another_disk 0.00s setup test_executable_table_function/test.py::test_executable_pool_storage_input_argument_python 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_attach_detach_partition 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_table_manipulations 0.00s setup test_executable_table_function/test.py::test_executable_storage_input_signalled_python 0.00s setup test_hedged_requests_parallel/test.py::test_query_with_no_data_to_sample 0.00s setup test_hedged_requests_parallel/test.py::test_send_table_status_sleep 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_inserts_selects 0.00s setup test_executable_table_function/test.py::test_executable_storage_input_sum_python 0.00s setup test_executable_table_function/test.py::test_executable_function_input_multiple_pipes_python 0.00s setup test_executable_table_function/test.py::test_executable_storage_no_input_bash 0.00s setup test_odbc_interaction/test.py::test_no_connection_pooling 0.00s setup test_http_handlers_config/test.py::test_config_static_handler 0.00s setup test_executable_table_function/test.py::test_executable_storage_input_argument_python 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_read_after_cache_is_wiped 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[True] 0.00s setup test_executable_table_function/test.py::test_executable_function_input_bash 0.00s teardown test_executable_table_function/test.py::test_executable_function_input_slow_python_timeout_increased 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_inserts_selects 0.00s teardown test_http_handlers_config/test.py::test_relative_path_static_handler 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_endpoint 0.00s teardown test_executable_table_function/test.py::test_executable_storage_input_bash 0.00s teardown test_manipulate_statistics/test.py::test_replicated_db 0.00s teardown test_executable_table_function/test.py::test_executable_pool_storage_input_slow_python 0.00s setup test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch 0.00s teardown test_executable_table_function/test.py::test_executable_function_input_argument_python 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_apply_new_settings 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_freeze_unfreeze 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[False] 0.00s setup test_executable_table_function/test.py::test_executable_function_input_slow_python_timeout_increased 0.00s teardown test_hedged_requests_parallel/test.py::test_send_data 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_azure_broken_parts 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_create_table 0.00s teardown test_ldap_external_user_directory/test.py::test_authentication_fail 0.00s teardown test_executable_table_function/test.py::test_executable_storage_no_input_bash 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_simple_insert_select 0.00s setup test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally 0.00s teardown test_executable_table_function/test.py::test_executable_storage_input_sum_python 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_freeze_unfreeze 0.00s setup test_executable_table_function/test.py::test_executable_function_input_signalled_python 0.00s teardown test_executable_table_function/test.py::test_executable_storage_input_slow_python 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_endpoint_new_container 0.00s setup test_manipulate_statistics/test.py::test_replicated_table_ddl 0.00s teardown test_odbc_interaction/test.py::test_concurrent_queries 0.00s teardown test_executable_table_function/test.py::test_executable_storage_input_send_chunk_header_python 0.00s setup test_executable_table_function/test.py::test_executable_storage_input_slow_python 0.00s teardown test_executable_table_function/test.py::test_executable_pool_storage_input_argument_python 0.00s teardown test_manipulate_statistics/test.py::test_replicated_table_ddl 0.00s teardown test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_attach_detach_partition 0.00s setup test_executable_table_function/test.py::test_executable_function_input_slow_python 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_move_partition_to_another_disk 0.00s setup test_executable_table_function/test.py::test_executable_pool_storage_input_multiple_pipes_python 0.00s teardown test_http_handlers_config/test.py::test_prometheus_handler 0.00s teardown test_executable_table_function/test.py::test_executable_storage_input_argument_python 0.00s setup test_odbc_interaction/test.py::test_mysql_insert 0.00s setup test_manipulate_statistics/test.py::test_single_node_wide 0.00s setup test_http_handlers_config/test.py::test_relative_path_static_handler 0.00s teardown test_executable_table_function/test.py::test_executable_function_input_python 0.00s teardown test_ldap_external_user_directory/test.py::test_authentication_pass 0.00s teardown test_executable_table_function/test.py::test_executable_function_no_input_python 0.00s setup test_executable_table_function/test.py::test_executable_storage_input_send_chunk_header_python 0.00s setup test_odbc_interaction/test.py::test_many_connections 0.00s teardown test_manipulate_statistics/test.py::test_single_node_normal 0.00s teardown test_executable_table_function/test.py::test_executable_storage_input_signalled_python 0.00s teardown test_executable_table_function/test.py::test_executable_function_input_slow_python 0.00s setup test_executable_table_function/test.py::test_executable_pool_storage_input_signalled_python 0.00s setup test_http_handlers_config/test.py::test_replicas_status_handler 0.00s teardown test_executable_table_function/test.py::test_executable_function_input_signalled_python 0.00s teardown test_executable_table_function/test.py::test_executable_pool_storage_input_count_python 0.00s setup test_odbc_interaction/test.py::test_mysql_odbc_select_nullable 0.00s teardown test_http_handlers_config/test.py::test_dynamic_query_handler 0.00s setup test_merge_tree_azure_blob_storage/test.py::test_simple_insert_select 0.00s setup test_executable_table_function/test.py::test_executable_function_input_python 0.00s setup test_hedged_requests_parallel/test.py::test_combination2 0.00s setup test_executable_table_function/test.py::test_executable_function_no_input_bash 0.00s setup test_ldap_external_user_directory/test.py::test_authentication_pass 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_endpoint 0.00s setup test_kafka_bad_messages/test.py::test_bad_messages_to_mv 0.00s setup test_executable_table_function/test.py::test_executable_pool_storage_input_count_python 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_endpoint_error_check 0.00s teardown test_odbc_interaction/test.py::test_mysql_simple_select_works 0.00s teardown test_odbc_interaction/test.py::test_mysql_insert 0.00s teardown test_executable_table_function/test.py::test_executable_pool_storage_input_signalled_python 0.00s teardown test_http_handlers_config/test.py::test_fixed_static_handler 0.00s teardown test_executable_table_function/test.py::test_executable_storage_input_python 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_read_after_cache_is_wiped 0.00s teardown test_merge_tree_azure_blob_storage/test.py::test_endpoint_without_prefix 0.00s teardown test_executable_table_function/test.py::test_executable_function_input_bash 0.00s setup test_http_handlers_config/test.py::test_fixed_static_handler 0.00s teardown test_executable_table_function/test.py::test_executable_pool_storage_input_python 0.00s setup test_executable_table_function/test.py::test_executable_pool_storage_input_slow_python 0.00s teardown test_executable_table_function/test.py::test_executable_function_input_multiple_pipes_python 0.00s setup test_executable_table_function/test.py::test_executable_storage_input_bash 0.00s teardown test_executable_table_function/test.py::test_executable_function_input_sum_python 0.00s setup test_executable_table_function/test.py::test_executable_function_no_input_python 0.00s setup test_odbc_interaction/test.py::test_mysql_simple_select_works 0.00s teardown test_odbc_interaction/test.py::test_many_connections 0.00s teardown test_executable_table_function/test.py::test_executable_function_no_input_bash 0.00s teardown test_odbc_interaction/test.py::test_mysql_odbc_select_nullable =========================== short test summary info ============================ FAILED test_hedged_requests_parallel/test.py::test_combination2 - assert 6.04... PASSED test_keeper_client/test.py::test_base_commands PASSED test_keeper_client/test.py::test_big_family PASSED test_keeper_client/test.py::test_delete_stale_backups PASSED test_keeper_client/test.py::test_find_super_nodes PASSED test_http_handlers_config/test.py::test_absolute_path_static_handler PASSED test_keeper_client/test.py::test_four_letter_word_commands PASSED test_keeper_client/test.py::test_get_all_children_number PASSED test_keeper_client/test.py::test_quoted_argument_parsing PASSED test_keeper_client/test.py::test_rm_with_version PASSED test_keeper_client/test.py::test_rm_without_version PASSED test_keeper_client/test.py::test_set_with_version PASSED test_keeper_client/test.py::test_set_without_version PASSED test_manipulate_statistics/test.py::test_replicated_db PASSED test_ldap_external_user_directory/test.py::test_authentication_fail PASSED test_ldap_external_user_directory/test.py::test_authentication_pass PASSED test_executable_table_function/test.py::test_executable_function_input_argument_python PASSED test_executable_table_function/test.py::test_executable_function_input_bash PASSED test_executable_table_function/test.py::test_executable_function_input_multiple_pipes_python PASSED test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes PASSED test_hedged_requests_parallel/test.py::test_combination1 PASSED test_executable_table_function/test.py::test_executable_function_input_python PASSED test_manipulate_statistics/test.py::test_replicated_table_ddl PASSED test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally PASSED test_http_handlers_config/test.py::test_config_static_handler PASSED test_executable_table_function/test.py::test_executable_function_input_signalled_python PASSED test_intersecting_parts/test.py::test_intersect_parts_when_restart PASSED test_ldap_external_user_directory/test.py::test_role_mapping PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception PASSED test_merge_tree_azure_blob_storage/test.py::test_alter_table_columns PASSED test_merge_tree_azure_blob_storage/test.py::test_apply_new_settings PASSED test_jbod_balancer/test.py::test_jbod_balanced_merge PASSED test_http_handlers_config/test.py::test_defaults_http_handlers PASSED test_manipulate_statistics/test.py::test_single_node_normal PASSED test_merge_tree_azure_blob_storage/test.py::test_attach_detach_partition PASSED test_logs_level/test.py::test_check_client_logs_level PASSED test_merge_tree_azure_blob_storage/test.py::test_azure_broken_parts PASSED test_executable_table_function/test.py::test_executable_function_input_slow_python PASSED test_hedged_requests_parallel/test.py::test_query_with_no_data_to_sample PASSED test_manipulate_statistics/test.py::test_single_node_wide PASSED test_merge_tree_azure_blob_storage/test.py::test_big_insert PASSED test_merge_tree_azure_blob_storage/test.py::test_create_table PASSED test_merge_tree_azure_blob_storage/test.py::test_endpoint PASSED test_merge_tree_azure_blob_storage/test.py::test_endpoint_error_check PASSED test_merge_tree_azure_blob_storage/test.py::test_endpoint_new_container PASSED test_merge_tree_azure_blob_storage/test.py::test_endpoint_without_prefix PASSED test_interserver_dns_retires/test.py::test_query PASSED test_hedged_requests_parallel/test.py::test_send_data PASSED test_merge_tree_azure_blob_storage/test.py::test_freeze_unfreeze PASSED test_http_handlers_config/test.py::test_defaults_http_handlers_config_order PASSED test_keeper_secure_client/test.py::test_connection PASSED test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command PASSED test_hedged_requests_parallel/test.py::test_send_table_status_sleep PASSED test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[False] PASSED test_http_handlers_config/test.py::test_dynamic_query_handler PASSED test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[True] PASSED test_http_handlers_config/test.py::test_fixed_static_handler PASSED test_merge_tree_azure_blob_storage/test.py::test_inserts_selects PASSED test_merge_tree_azure_blob_storage/test.py::test_move_partition_to_another_disk PASSED test_merge_tree_azure_blob_storage/test.py::test_read_after_cache_is_wiped PASSED test_merge_tree_azure_blob_storage/test.py::test_simple_insert_select PASSED test_executable_table_function/test.py::test_executable_function_input_slow_python_timeout_increased PASSED test_executable_table_function/test.py::test_executable_function_input_sum_python PASSED test_executable_table_function/test.py::test_executable_function_no_input_bash PASSED test_executable_table_function/test.py::test_executable_function_no_input_python PASSED test_merge_tree_azure_blob_storage/test.py::test_table_manipulations PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_argument_python PASSED test_http_handlers_config/test.py::test_predefined_query_handler PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_count_python PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_multiple_pipes_python PASSED test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_python PASSED test_keeper_three_nodes_start/test.py::test_smoke PASSED test_http_handlers_config/test.py::test_prometheus_handler PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_signalled_python PASSED test_http_handlers_config/test.py::test_relative_path_static_handler PASSED test_keeper_znode_time/test.py::test_between_servers PASSED test_http_handlers_config/test.py::test_replicas_status_handler PASSED test_keeper_znode_time/test.py::test_server_restart PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_slow_python PASSED test_executable_table_function/test.py::test_executable_pool_storage_input_sum_python PASSED test_executable_table_function/test.py::test_executable_storage_input_argument_python PASSED test_executable_table_function/test.py::test_executable_storage_input_bash PASSED test_executable_table_function/test.py::test_executable_storage_input_python PASSED test_executable_table_function/test.py::test_executable_storage_input_send_chunk_header_python PASSED test_executable_table_function/test.py::test_executable_storage_input_signalled_python PASSED test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream PASSED test_executable_table_function/test.py::test_executable_storage_input_slow_python PASSED test_executable_table_function/test.py::test_executable_storage_input_sum_python PASSED test_executable_table_function/test.py::test_executable_storage_no_input_bash PASSED test_executable_table_function/test.py::test_executable_storage_no_input_python PASSED test_kafka_bad_messages/test.py::test_bad_messages_to_mv SKIPPED [6] test_odbc_interaction/test.py:57: Sanitizers cannot work with third-party shared libraries SKIPPED [1] test_memory_profiler_min_max_borders/test.py:25: Disabled for sanitizers SKIPPED [1] test_jemalloc_percpu_arena/test.py:62: Compiled without jemalloc (USE_JEMALLOC=b'') ============= 1 failed, 91 passed, 8 skipped in 422.87s (0:07:02) ============== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 492, in subprocess.check_call(cmd, shell=True, bufsize=0) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_u1sk54 --privileged --dns-search='.' --memory=30709022720 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=5ccda723c1fc -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=d862517635bf -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 --report-log=parallel1_0.jsonl --report-log-exclude-logs-on-passed-tests test_executable_table_function/test.py::test_executable_function_input_argument_python test_executable_table_function/test.py::test_executable_function_input_bash test_executable_table_function/test.py::test_executable_function_input_multiple_pipes_python test_executable_table_function/test.py::test_executable_function_input_python test_executable_table_function/test.py::test_executable_function_input_signalled_python test_executable_table_function/test.py::test_executable_function_input_slow_python test_executable_table_function/test.py::test_executable_function_input_slow_python_timeout_increased test_executable_table_function/test.py::test_executable_function_input_sum_python test_executable_table_function/test.py::test_executable_function_no_input_bash test_executable_table_function/test.py::test_executable_function_no_input_python test_executable_table_function/test.py::test_executable_pool_storage_input_argument_python test_executable_table_function/test.py::test_executable_pool_storage_input_count_python test_executable_table_function/test.py::test_executable_pool_storage_input_multiple_pipes_python test_executable_table_function/test.py::test_executable_pool_storage_input_python test_executable_table_function/test.py::test_executable_pool_storage_input_signalled_python test_executable_table_function/test.py::test_executable_pool_storage_input_slow_python test_executable_table_function/test.py::test_executable_pool_storage_input_sum_python test_executable_table_function/test.py::test_executable_storage_input_argument_python test_executable_table_function/test.py::test_executable_storage_input_bash test_executable_table_function/test.py::test_executable_storage_input_python test_executable_table_function/test.py::test_executable_storage_input_send_chunk_header_python test_executable_table_function/test.py::test_executable_storage_input_signalled_python test_executable_table_function/test.py::test_executable_storage_input_slow_python test_executable_table_function/test.py::test_executable_storage_input_sum_python test_executable_table_function/test.py::test_executable_storage_no_input_bash test_executable_table_function/test.py::test_executable_storage_no_input_python test_hedged_requests_parallel/test.py::test_combination1 test_hedged_requests_parallel/test.py::test_combination2 test_hedged_requests_parallel/test.py::test_query_with_no_data_to_sample test_hedged_requests_parallel/test.py::test_send_data test_hedged_requests_parallel/test.py::test_send_table_status_sleep test_http_handlers_config/test.py::test_absolute_path_static_handler test_http_handlers_config/test.py::test_config_static_handler test_http_handlers_config/test.py::test_defaults_http_handlers test_http_handlers_config/test.py::test_defaults_http_handlers_config_order test_http_handlers_config/test.py::test_dynamic_query_handler test_http_handlers_config/test.py::test_fixed_static_handler test_http_handlers_config/test.py::test_predefined_query_handler test_http_handlers_config/test.py::test_prometheus_handler test_http_handlers_config/test.py::test_relative_path_static_handler test_http_handlers_config/test.py::test_replicas_status_handler test_intersecting_parts/test.py::test_intersect_parts_when_restart test_interserver_dns_retires/test.py::test_query test_jbod_balancer/test.py::test_jbod_balanced_merge test_jbod_balancer/test.py::test_replicated_balanced_merge_fetch test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena test_kafka_bad_messages/test.py::test_bad_messages_parsing_exception test_kafka_bad_messages/test.py::test_bad_messages_parsing_stream test_kafka_bad_messages/test.py::test_bad_messages_to_mv test_keeper_client/test.py::test_base_commands test_keeper_client/test.py::test_big_family test_keeper_client/test.py::test_delete_stale_backups test_keeper_client/test.py::test_find_super_nodes test_keeper_client/test.py::test_four_letter_word_commands test_keeper_client/test.py::test_get_all_children_number test_keeper_client/test.py::test_quoted_argument_parsing test_keeper_client/test.py::test_rm_with_version test_keeper_client/test.py::test_rm_without_version test_keeper_client/test.py::test_set_with_version test_keeper_client/test.py::test_set_without_version test_keeper_reconfig_replace_leader_in_one_command/test.py::test_reconfig_replace_leader_in_one_command test_keeper_secure_client/test.py::test_connection test_keeper_three_nodes_start/test.py::test_smoke test_keeper_znode_time/test.py::test_between_servers test_keeper_znode_time/test.py::test_server_restart test_ldap_external_user_directory/test.py::test_authentication_fail test_ldap_external_user_directory/test.py::test_authentication_pass test_ldap_external_user_directory/test.py::test_push_role_to_other_nodes test_ldap_external_user_directory/test.py::test_remote_query_user_does_not_exist_locally test_ldap_external_user_directory/test.py::test_role_mapping test_logs_level/test.py::test_check_client_logs_level test_manipulate_statistics/test.py::test_replicated_db test_manipulate_statistics/test.py::test_replicated_table_ddl test_manipulate_statistics/test.py::test_single_node_normal test_manipulate_statistics/test.py::test_single_node_wide test_memory_profiler_min_max_borders/test.py::test_trace_boundaries_work test_merge_tree_azure_blob_storage/test.py::test_alter_table_columns test_merge_tree_azure_blob_storage/test.py::test_apply_new_settings test_merge_tree_azure_blob_storage/test.py::test_attach_detach_partition test_merge_tree_azure_blob_storage/test.py::test_azure_broken_parts test_merge_tree_azure_blob_storage/test.py::test_big_insert test_merge_tree_azure_blob_storage/test.py::test_create_table test_merge_tree_azure_blob_storage/test.py::test_endpoint test_merge_tree_azure_blob_storage/test.py::test_endpoint_error_check test_merge_tree_azure_blob_storage/test.py::test_endpoint_new_container test_merge_tree_azure_blob_storage/test.py::test_endpoint_without_prefix test_merge_tree_azure_blob_storage/test.py::test_freeze_unfreeze 'test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[False]' 'test_merge_tree_azure_blob_storage/test.py::test_insert_same_partition_and_merge[True]' test_merge_tree_azure_blob_storage/test.py::test_inserts_selects test_merge_tree_azure_blob_storage/test.py::test_move_partition_to_another_disk test_merge_tree_azure_blob_storage/test.py::test_read_after_cache_is_wiped test_merge_tree_azure_blob_storage/test.py::test_simple_insert_select test_merge_tree_azure_blob_storage/test.py::test_table_manipulations test_odbc_interaction/test.py::test_concurrent_queries test_odbc_interaction/test.py::test_many_connections test_odbc_interaction/test.py::test_mysql_insert test_odbc_interaction/test.py::test_mysql_odbc_select_nullable test_odbc_interaction/test.py::test_mysql_simple_select_works test_odbc_interaction/test.py::test_no_connection_pooling -vvv " altinityinfra/integration-tests-runner:226bfaf75ac1 ' returned non-zero exit status 1.